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IMAGE PROCESSING APPARATUS AND METHOD 



Field of the Invention 

The present invention relates to colour processors operable to process input 
pixels representing a colour image to form groups of output colour component signal 
5 samples, w^herein the number of samples representing the image is preferably reduced. 

The present invention also relates to image processing apparatus operable to 
reproduce pixels representative of a colour image from groups of colour component 
signal samples, each group representing a pair of pixels having two luminance and first 
and second chrominance samples. 
10 Background of the Invention 

It is known in the technical field of colour image processing to convert the red, 
green and blue (RGB) colour component signal samples of pixels representing an 
image into groups of component signal samples each having a luminance (Y) and two 
chrominance samples (U, V). Representing the RGB pixels as YUV signal samples 

15 provides a facility for reducing an amount of information, which must be 
communicated to represent a colour image. The reduction can be arranged by 
reducing or discarding some of the chrominance information without or with a reduced 
likelihood of causing a noticeable degradation to the reproduced image. This is 
because the human eye is less sensitive to loss of chrominance (colour) information 

20 from an image than luminance information. 

The himian eye's reduced sensitivity to loss of chrominance information can be 
used to reduce an amount of information, which is required to store a colour image. 
For example, it is known to reduce a number of samples required to store a digital 
colour image by converting pixels having RGB components into YUV form, 

25 discarding the UV chrominance values for every other pixel and storing the luminance 
value Y and storing the other chrominance values. The format of the resulting stored 
colour image is known as 4:2:2. When the colour image is reproduced, the UV 
chrominance values which have been discarded are reproduced from the UV 
chrominance values which have been stored. 
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For some applications, such as for hand held personal digital assistants or 
mobile radiotelephones having display devices, a reduction in an amount of 
information required to represent an image is particularly advantageous. Reducing the 
amount of information required to represent the image can provide an advantage, for 
5 example, with respect to the cost of the device as a result of a reduction in the size of a 
memory for storing the image. However, as far as possible, such a reduction in the 
amount of information required to represent an image should not affect the quality of 
the reproduced image. 
Summary of the Invention 

10 According to the present invention there is provided a colour processor 

operable to process input pixels, each comprising three colour component signal 
samples, to produce output colour component signal samples. The colour processor is 
operable to receive first and second input pixels and to generate from each pixel a 
luminance value from the corresponding three colour component samples of each pixel 

15 respectively. The colour processor forms first and second output chrominance values 
for each of the first and second input pixels. The output chrominance values are 
formed by calculating from each of the colour components of each input pixel first and 
second chrominance values, and averaging the values of the first chrominance value of 
the first and second input pixels and averaging the second chrominance values of the 

20 first and second input pixels. The first and second output chrominance values are 
produced from the averaged first and second chrominance values respectively. The 
output colour component signal samples are formed for the first and second input 
pixels from the luminance value for each pixel and the first and second output 
chrominance values. 

25 Embodiments of the present invention provide a colour processor, which is 

arranged to reduce a number of signal samples, which are required to represent a 
colour image. The reduction is provided by representing a pair of pixels as two 
luminance value signal samples (Yl, Y2) and first and second chrominance values 
(UV). As a result a capacity of a memory which is required to store a representation of 

30 the image is reduced by two samples for each pixel pair. This represents a reduction of 
33%. 
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Effectively the colour processor is arranged to compress the colour image by 
discarding colour information. Therefore, as with conventional colour YUV 4:4:4 to 
4:2:2, the compression process is lossy. However, unlike conventional processing a 
colour processor embodying the invention forms two chrominance values UV for each 
5 pair of pixels by calculating the corresponding chrominance values for the first pixel 
UlVl, and calculating the chrominance values for the second pixel U2V2. The two 
output chrominance VEilues UV are then formed by averaging the two corresponding 
values UlVl, U2V2 to produce a common value UV for the pixel pair. Forming the 
two-chrominance values UV for a pair of pixels provides a reduction in the nvmiber of 

10 samples required to represent the image. Furthermore, the reduction is produced in a 
way which provides a facility for improving the likelihood of maintaining text and 
other detail which may be present in the image, which may be lost if the chrominance 
values for the second pixel are simply discarded as with conventional processing. 

According to an aspect of the present invention there is provided an image 

15 processing apparatus operable to reproduce pixels representative of a colour image 
from groups of colour component signal samples representing the image. Each of the 
groups represents two of the pixels and comprises two input luminance values, one for 
each pixel, and first and second input chrominance values formed by averaging first 
and second chromincance values for each pixel. The apparatus comprises a de- 

20 compressing processor operable to receive the groups of colour component signal 
samples and to generate output pixels each comprising three colour component values. 
The apparatus also comprises a detail detection processor operable to detect whether 
one of the first and second pixels is representative of substantially white or 
substantially black and the other of the pixels is not representative of substantially 

25 white or substantially black. If so, the de-compressing processor is arranged to assign 
to first and second chrominance values for one of the first and second pixels 
representing substantially white or substantially black the value of zero, to assign to 
first and second chrominance values for the other of the first and second pixels, not 
representing substantially white or black, the value of twice the first and second input 

30 chrominance values respectively. The de-compressing processor then reproduces the 
three colour components of each pixel from the corresponding input luminance value 
of each pixel and the assigned first and second chrominance values. Otherwise, the 
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de-compressing processor is operable to reproduce the three colour components of 
each output pixel from the corresponding input luminance value in combination with 
the first and second input chrominance values. 

Forming a compressed representation of the colour image by averaging the 
5 two-chrominance values for a pair of pixels provides an advantage when recovering 
the original image, particularly for example where the image contains text and/or 
detail. Embodiments of the present invention provide an image processing apparatus 
including a de-compressing processor and a detail detection processor. The detail 
detection processor determines whether one of the two pixels represented by each 

10 group is representative of substantially white or substantially black and the other pixel 
is representative of not being substantially white or substantially black. Detecting 
white or black in only one of the pixels is likely to correspond to the pixel pair 
representing part of a text character or detail. Accordingly, in order to increase the 
likelihood of preserving the text and detail in the reproduced image, once black or 

15 white has been detected in one of the two pixels, the de-compressing processor is 
arranged to assign chrominance values (Ul, VI) for one of the pixels, representing 
white or black to zero. The chrominance values (U2, V2) for the other pixel not 
representing white or black is assigned the value of twice the value of the first and 
second input chrominance values respectively. Assigning these values to the 

20 chromincance samples of the pixels to be reproduced has an effect that the RGB 
components of the reproduced pixels are more likely to reflect the pixel values of the 
original image, even though the compression process was lossy. As a result the text 
information or detail information is preserved in the reproduced image. In contrast, 
conventional compression techniques, which discard the chrominance values of the 

25 second pixel in the pair, are less likely to recover such text information, resulting in a 
likelihood of the text information being corrupted. 

Various fiirther aspects and features of the present invention are defined in the 
appended claims. 
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Brief Description of Drawings 

Embodiments of the present invention will now be described by way of 
example only with reference to the accompanying drawings, where like parts are 
provided with corresponding reference numerals, and in which: 
5 Figure 1 is a schematic block diagram of an LCD display module; 

Figure 2 is a schematic block diagram of an LCD display module including a 
colour compressing processor and an image processor according to an embodiment of 
the invention; 

Figure 3A is a representation of an example colour image, including text 
10 information; Figure 3B is a representation of the example colour image of Figure 3 A 
after compression using a conventional 4:2:2 compression processing; 

Figure 4 is a schematic block diagram of a luminance generating circuit 
forming part of the colour compressing processor shown in Figure 2; 

Figure 5 is a schematic block diagram of a chrominance generating circuit 
1 5 forming part of the colour compressing processor shown in Figure 2; 

Figure 6 is a schematic block diagram of the image processor shown in Figure 

2; and 

Figure 7A is a representation of the colour image of Figure 3A after 
compression processing; Figure 7B is a representation of the example colour image of 
20 Figure 3 A after de-compression by the image processor shown in Figure 6. 
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Description of Preferred Embodiments 

An embodiment of the present invention will now be described with reference 
to an LCD display module. Figure 1 provides an illustration of a typical LCD display 
5 module such as that which would be used within a mobile radiotelephone or a personal 
digital assistant. Generally, there is an increasing demand to display digital images 
using hand held devices such as mobile radiotelephones. In particular, third generation 
(3G) mobile radio telecommunications systems will provide a facility for 
communicating colour images and so mobile radiotelephones for 3G systems will 

10 require a facility for displaying such digital colour images. 

A typical display module for displaying colour images includes an LCD 
display panel 1 as shown in Figure 1. Such a display module comprises a display 
memory 2 which is arranged to store pixel information representative of a digital 
image which is to be displayed on the LCD display panel L Pixels which are 

15 representative of the colour image to be displayed are received on a connecting 
channel 4 and written into the display memory 2 using write address logic 8. When 
the image is to be displayed, the signal samples, stored in the memory 2, are read by 
read address logic 10 and converted into the analogue domain by a digital to analogue 
converter 12 before being displayed on the LCD panel L 

20 As already explained, the present invention provides a facility for reducing an 

amoimt of data storage capacity which is required to store the digital colour image, 
whilst maintaining the quality of the image to be displayed on, for example, the LCD 
panel 2. As will be explained, the present invention provides a particular advantage 
when the image contains fine detail or fine text information, for example, where part 

25 of a text character is only one pixel wide. 

An embodiment of the present invention is illustrated in Figure 2. Figure 2 
shows the LCD display module of Figure 1 in combination with a colour compressing 
processor 20 and an image processor 30. In order to reduce the storage capacity of the 
display memory 2, the colour compressing processor 20 is arranged to receive the 

30 pixels representative of the colour image and to reduce the nxmiber of samples which 
are used to represent the image by processing the pixels of the image. 
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Correspondingly, when the signal samples representing the image are read from the 
display memory 2, then the image processor 30 is arranged to decompress the signal 
samples to recover the pixels of the image so that the image can be displayed on the 
LCD panel 1. For the present example, it is assumed that the pixels of the image 
5 received on the connecting channel 4 are represented as 6 bit samples for each of the 
coloxir components RGB, although it will be appreciated that other numbers of bits per 
sample may be used. 

As already explained, a particular problem with conventional RGB to YUV 
colour compression processing, such as that referred to as 4:2:2, is that where text or 

10 detail exists in the image, the clarity of this text may be reduced. Such detail may be 
blurred as a result of colour components being discarded in order to form the 
compressed image. A result of compressing an example colour image using 
conventional 4:2:2 processing is illustrated in Figure 3(a) and Figure 3(b). Figure 3(a) 
provides an example image including text information. As illustrated in Figure 3(b), a 

15 result of using conventional 4:2:2 compression encoding in which the chrominance 
values UV are discarded for every other pixel, is that the fine text information is either 
blurred or the colour is lost or corrapted producing an imsatisfactory reproduced 
image. 

Embodiments of the present invention therefore seek to compress the digital 
20 image whilst preserving such fine text information in the recovered image. To this 
end, the colour compressing processor 20 is arranged to form U and V values for a pair 
of pixels by averaging the corresponding U and V chrominance values for each pixel 
pair. As shown in Figure 2, the colour compressing processor comprises a luminance 
forming circuit 24 and a chrominance forming circuit 28. An embodiment of the 
25 colour compressing processor 20 is shown in Figures 4 and 5. 

Figure 4 provides a functional block diagram of the luminance forming circuit 
24 which forms the Itiminance value Y from the RGB values of each pixel. The 
calculation performed by circuit in Figure 4 is expressed in the equation below: 
1) Y = (77R + 150G + 29B)/128 
30 2) Y = (Y+l)/2 

Forming the luminance value Y for each pixel using the functional block 
diagram illustrated in Figure 4, generates a luminance value which maps the 6 bit 
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values of the RGB components onto a 6 bit luminance value in the range between -32 
and +31. 

Figure 5 provides an illustration of a functional block diagram of the 
chrominance forming circuit 28. The calculation performed by the chrominance 
5 forming circuit 28 is illustrated by the equations below: 

1) U - (131B - (44R + 87G))/128 

V = (13 IR - (1 lOG + 21B))/128 

2) U = (U+l)/2 

V = (V + l)/2 

10 In Figure 5 the values given in brackets are those which are used for forming 

the second chrominance value V. As with the luminance forming circuit 24, the 
chrominance forming circuit 28 has an advantage in providing a 6 bit value for the U 
and V components generated from the 6 bit input RGB components, which produces 
values in the range -32 to +3 1 . 

15 As illustrated in Figure 5, the chrominance forming circuit 28 is arranged to 

generate two chrominance values UV for two input pixels, that is, two input pixels 
each having RGB values. More particularly, the two chrominance values UV are 
formed by averaging the corresponding chrominance values Ul, VI and U2, V2 which 
are formed for each pixel. Thus, unlike conventional compression processing the 

20 second two chrominance values U2, V2 are not discarded but combined to form a 
common chrominance values for the two input pixels. 

Retuming to Figure 2, the write address logic 8 is arranged to store the 
component signal samples representative of the image in the display memory 2. Four 
samples are stored to represent two pixels otherwise requiring six samples, thereby 

25 providing a 33% saving in the memory capacity for this example. The samples are 
stored in the display memory 2 as YIU and Y2V. 

Compressing the pixels by forming common chrominance values UV for each 
pair of pixels provides a particular advantage in overcoming the technical problem 
illustrated in Figures 3(a) and 3(b) in which text information can be corrupted. This 

30 advantage will be understood following explanation of the operation of the de- 
compression process provided by the image processor 30. 
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As shown in Figure 2, the image processor 30 comprises a detail detection 
processor 34 and a YUV to RGB de-compression processor 38. YUV compressed 
samples are received by the detail detection processor 34 and the YUV to RGB de- 
compression processor 38 from the read address logic 10. The detail detection 
5 processor is arranged to control the YUV to RGB de-compression processor 38 in 
order to recover the RGB values in a way, which preserves the text information. The 
image processor 30 is shown in more detail in Figure 6. 

As illustrated in Figure 6, the detail detection processor comprises for each 
luminance value a pair of comparators 40, 42, 44, 46. Each of the comparators 
1 0 compares one of the luminance values with a threshold value representing white and a 
threshold value representing black. The comparators 40, 42, 44, 46 therefore 
determine whether either of the luminance values Yl, Y2 are representative of white 
or black. 

As will be appreciated, the threshold values provided to the comparators 40, 

15 42, 44, 46 are selected effectively to identify that one of the two pixels is 
representative of white or almost white or black or almost black. Detection is 
determined if either luminance value exceeds the white threshold or is lower than the 
black threshold. The presence of white or black in one pixel but not the other reflects 
a change in the image from one pixel to another of the pixel pair, which is likely to 

20 represent the presence of detail or text information in the image. 

Control signals representative of a result of the comparisons performed by the 
comparators 40, 42, 44, 46 are fed to the YUV to RGB de-compression processor 38. 
The control signals are received at selection logic gates 50, 52, 54, 56, Consequent 
upon the output from the comparators received on the connection channels 36.1, 36.2, 

25 36.3, 36.4, the selection gates 50, 52, 54, 56 select either the value of zero, twice the 
value of the input chrominance values U or V, or the input chrominance value U or V. 
Correspondingly therefore, the selection gates, 50, 52, 54, 56 produce at each 
respective output, reproduced chrominance values Ul, VI, U2, V2. 

Also forming part of the de-compression processor 38 are multiplying circuits 

30 60, 62. The multiplying circuits are arranged to produce twice the value of the 
corresponding input chrominance values U, V and the input chrominance values U, V 
which are fed to the selection gates 50, 52, 54, 56. 
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Having reproduced the chrominance values for each pixel Ul, VI and U2, V2, 
a YUV to RGB conversion processor 70 is arranged to convert the YUV component 
values for the first pixel Yl, Ul, VI and the second pixel Y2, U2, V2 into the RGB 
values of the reproduced pixel pair. Therefore for each group of component signal 
5 samples Y1UY2V a pixel pair is formed, which is represented as RIGIBI, R2G2B2. 
As shown in Figure 2, the RGB VEilues are then fed to the digital to analogue converter 
12 for display on the LCD panel 2. 

According to the operation of the detail detection processor 34, in combination 
with the de-compressing processor 38, a functional arrangement is formed for the 
10 regeneration of the YUV values for each pair of pixels. The functional arrangement is 
represented by the following algorithm: 

1) Pixel 1 (Yl) represents white or black and pixel 2 (Y2) represents not 
white or black then: 

Yl = Y1,U1 =0, VI =0 
15 Y2 = Y2, U2 = Ux2, V2 = Vx2 

2) Pixel 1 (Yl) represents not white or black and pixel 2 (Y2) represents 
white or black: 

Yl = Yl, Ul = Ux2, VI = Vx2 
Y2 = Y2, U2 = 0, V2 = 0 
20 3) For all other pixels: 

Yl = Y1,U1 =U, VI = V 
Y2 = Y2, U2 = U, V2 = V 

The colour compressing processor 20 and image processor 30 operate in 
combination to compress the amount of data required to represent an image whilst 

25 preserving text information. For the image illustrated in Figure 3(a), a result of 
processing by the colour compressing processor 20 and the image processor 30 is 
illustrated in Figures 7(a) and 7(b). Figure 7(a) illustrates the text of the image in 
Figure 3(a) which results when the colour compressing processor has processed the 
pixels of the image in a way which reduces the chrominance components. As 

30 illustrated, there is substantial blurring in this image resulting from the averaging 
performed by the colour compressing processor in order to form the two chrominance 
values. However, as shown in Figure 7(b), a result of de-compressing the compressed 
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colour image as performed by the image processor 30, according to an embodiment of 
the invention, is to recover the original image with the effect of retaining the text 
detail. 

As will be appreciated by those skilled in the art, various modifications may be 
5 made to the embodiments herein before described without departing from the scope of 
the present invention. In particular, it will be appreciated that the colour compressing 
processor and the image processor may be used in combination with any type of 
display. The invention is therefore not limited to applications with an LCD display. 
Embodiments of the present invention find particular application where there is a 
10 requirement to reduce memory size or components of a product requiring a facility for 
displaying colour images. It will be appreciated that the invention finds application 
with colour depth values other than 18-bits such as 24-bits. For larger colour depth 
values such as 24-bits, the reduction in memory size will be even greater in accordance 
with the size of the colour component signal samples. 
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